Skip to content

Conversation

@zakiali
Copy link
Collaborator

@zakiali zakiali commented Mar 5, 2025

Adds an image processing tool to the developer MCP. If you give goose an image path, the tool will read it in and process it (similar to the screen capture tool).

Some limits:

  • 10mb is the limit on the file size (this was arbitrary)
  • image gets resized similar to screen cap's to fit with provider limitations
  • works best when there are no spaces in the file name (I found that models have trouble escaping correctly)

Copy link
Contributor

@kalvinnchau kalvinnchau left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice!

@zakiali zakiali merged commit 6cb6e1d into main Mar 7, 2025
6 checks passed
@zakiali zakiali deleted the zaki/image-tool branch March 7, 2025 00:16
@zakiali zakiali mentioned this pull request Mar 7, 2025
1 task
michaelneale added a commit that referenced this pull request Mar 7, 2025
* main:
  bugfix: refactor workdirs to be async-safe, and simpler (#1558)
  feat: split required_extensions in bench to builtin/external (#1547)
  fix: continue to use resumed session after confirmation is cancelled (#1548)
  feat: add image tool to developer mcp (#1515)
  docs: using gooseignore (#1554)
  ci: use cargo update --workspace to ensure Cargo.lock is updated (#1539)
  fix: respond to interrupted tool calls with a ToolResponseMessageContent (#1557)
  fix: get tool def back to chat mode (#1538)
  ui: add default icon (#1553)
  fix: fix summarize agent, use session_id and add provider fn (#1552)
  feat(agent): memory condensation for longer context (#1457)
  docs: goose tips blog (#1550)
  docs: update to provider view (#1546)
  docs: resuming sessions (#1543)
  feat: goose bench framework for functional and regression testing
  feat: use refresh_tokens from databricks api (#1517)
  feat: use Ctrl/Cmd + ↑/↓ to navigate message history (#1501)
  feat: remove tools from chat mode (#1533)
  feat: use dropdown for goose selection (#1531)
  docs: goosehints in desktop (#1529)
lily-de pushed a commit that referenced this pull request Mar 7, 2025
ahau-square pushed a commit that referenced this pull request Mar 7, 2025
ahau-square pushed a commit that referenced this pull request May 2, 2025
cbruyndoncx pushed a commit to cbruyndoncx/goose that referenced this pull request Jul 20, 2025
@cgwalters
Copy link
Contributor

Hi @zakiali are you actively using this still? We are debating it in #3976 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants